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ABSTRACT ' :'■_![_ 

A social organizational theory is outlined, and how 
types of data drawn from it may be useful in an evaluation context is 
indicated. Anthropological ethnography is proposed as a moxe powerful 
tool in those evaluations undertaken from a phenomenological ' \ 
perspective! Naturalistic/qualitative evaluation lacks a theoretical, 
perspective^ on how groups, of persons order their social lives. The 
constitutive ethnographic theory of social organization is explained. 
This theory is presented to provide a link between the ";. , 

phenomenological perspective and the field method of anthropological- 
ethnography. Ethnographic evaluation inquiry allocates resources such 

that ethnographic observation takes precedence over interviewing. 

Interviews are primarily used as guides 4 to observation . Constitutive _ 
ethnographers believe that group members display* their sociocultural 
standards in interaction. They seek patterns of co-occurrence among 
phenomena. The program's definition and boundaries are studied as 
problematic, inquiry -is centered on interactional events. (DWH) 
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Introduction 



Through the last decade or so* the purposes and sassump^ons .M3f . ■:///. 

evaluation have been repeatedly re-examined, expanded arid clarifi-ed'. .MSv. \: 

— ' * . ■ . ' ■■ ■ . - . ^ r . ; - - r -.■ - . 

models of evalttation-4iav£ been proposed/ the functions arid methods of j 

■'- . ' - J •- . - - - - .- V: ; . , V ■ . 4 ■ • ' ^ 

evaluation have been- extended and diversified . Largely as^ a consequence of 

these developments, there has' been in educational evaluation, as in . - / 

educational research generally (Rist, 1 980) ^ expanding interest . in and use . 

6f qualitative field research. Writing on the uses of /'naturalistic 

inquiry" and "qualitative methods" in evaluation has increased markedly in 

the past five years (e.g., Gub"a, 1978; Hamilton and others, 1978; House, 

;•/ . 19775 Pa tior/,* 1980). Eyal uation model s : based expl icjtly on naturalistic 

paradigms ha^beeri introduced. (See,, for example, Guba and Lincoln, 1981; 

and Parlett and Hamilton* 1976.) Federal ,arid state education agencies have 

- come to call regularly for field research or case study component! in the 

VV--: program evaluations and policy studies for which they con£ra£t (c.f ., 

: |#: Herriott-X Firestone, 1982). Evaluators %i school Hi stricts h?ve^egun tt 

"'■f-X-Or.- ...... 

.•"seek the assistance of trained field researchers both in conducting 

•' :\ 1 " ' ■ ; • •• ■:>'■: 1 

. ■ \ ■ ■ ■■ • . ' . ■ ' - 1 

evaluations and training district personnel (e.g., Dprr-Bremme* 1981a, 

3 981b) - The general trend is well -exemplified in the recent advice of 

Cfonbach- and* his associates (1980:223): : v 

; * * The v evaluator will be wise not to declare allegiance : 

to either a quantitative^ ' * 

methodology.. He cari draw on botfi styles, at appropriate 
times and in -apprdpriate amounts. Those who advocate 
an evaluation pfan.devoid of .one kind of information 
or the other carry the burden of justifying the' ■ 
excl us fori; ■ ;Y" * , ; 



ERLC 



~7T r atten ^ \ (pS(k-l-7)' Qua*! i tatlvCT svaT ^^ 

. skme position: ' |. . / : : • . \- '\_ .-■/'' : r ' 

.Today's, equator tntist be sophisticate . ; ' 

. - research, methods yto the nuances- of particular evalua- ^ , 
/ ti.an questions and ■ the idiosyncracies of specific ; ;; ; 'V /; y t 

». ■ decision, maker needs.;;? \/'^ y... v ■ :\: • '. : \ .f^; 

Thus, iiW-a freld long* wedded' to experimental and quasi -experimental modes^ 

of inquiiry^ natural Tstie/qUaiat^ broad acceptance. /■ 

; The status in evaluation of anthropologically, and sociologically - ; 1 

based ethnographic f leldwork* however, is far 1 ess cl^ar. Little has -'been . 

written on ethnography per se by those in the evaluation community.. 

Indeed, the precise nature of the relationships between "naturatisti c 

inquiry" or "qualitative methods 1 ' and ethnographic rase arch ha ve y e t to be 

explicated in evaluation texts. For many in the field, these, terms and . / 

others —case study approach, ^fi el dwork, # etc.— have come to function 

virtually as synonyms. Evaluation metho^logists have not advocated doing 

ethnography; rather, ttiey .have: recommendeosa method ^of field study which 

they see as derived from "the^ethjlographic j/adition i$r anthropology (c.f . , 

Gub'aV 1 978; 21; Patton; 1 980:44) in evaluation practice, ft^Td research as' 

traditionally done by anthropologists: has most often. been substantially 



adapted in purpose ^ in response to clients' concerns 

for general izability afid reliability and to "the requirements^ of rel evance, 

.. : ■>•'•':. '. . ■" • •• ' , • • • v • ' 

timeliness, and utility of the pal icy arena" (Herriott and Firestone, 

1982:37)/ And even when evaluation /designs have included ethnographic 

fieldwork as such, the ethnographers .in the field* have found that t^ey face 

numerous pressures to depart from the theory-based inquiry principles -of 
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1*9#7T. Thus / jcdnceptual di stinctipfts between antftrdsDolbgieal ethriairaphy 
arid other' modes of qua! i tati ve- f i el d study have fbeem inadvertantly blurred 
irifth| field of evaluation; and simultaneously; the Hole "that ethno 



tot; 



rapmc 



■//>■ • 



: 70' ■■ 



...... „. . . ... , ... ,. . . .f 

inquiry can and should play in ^valuatifln Has- gone ir completely explored. 
■V* In this context, two questions in particular deserve exploration: 

(r - (1) What makes qualitative field research ethnc graphic? 

/That is, what "differentiates ethnographic inquiry in 
• 'particular from naturalistic .or qua! ttati ve i nc tfi ry - 

%y in general? - ; 

. t V r * (2) What can ethnographic fi el dwork contribute to an- 
• . / evaluation that other forms of qualitative investigation 
•. cannot? r , ' f j 

I address each of these questions in turn below. In 

Vnat is unique about ethnography is its orientation 

constructs that define the nature of social organization. These 



50 doing, I argue that 
to culture and related 



constructs, taken collectively as a theory of social organization, serve as 
the basi$ : for organizing and carrying out ethnographic fi el dwork. In the 



absence of some such theory of social organization,! I maintain, qualitative 
research fails to fulfill its potential : its descr|p1:ive validity 

(Erickson, 1978)' is jeopardized. As I el ab orate tfjis argument, I sketch 

■. ■ j "' ■ • ■ : ■ • ]..■•.. . ■ • 

out a social organizational theory and indicate how the kinds of data that, 

follows from it can be useful in an evaluation context. 
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•Most methodol ogists maintain that naturalistic inquiry or 

qualitative research (which I use here as alternative labels) and 

ethnographic fieldwork "are not one "and the same. Especially among 'Writers 

in' the field of evaluation, the prevailing view seems to be that 

anthropological ethnography is one. of the principle foundations of 

natural istic/quali tative * ' • » \ p. . ' " 

inquiry; This viewpoint is evident in two of the most comprehensive 

treatments of naturalistic/qualitative evaluation inquiry, Egon Guba's 

(1978) toward A Methodology of Naturalistic Inquiry in ^durational 

Evaluation and" Michael Patton's (1986') Qualitative Eval uation Methods. 

Guba (1978: 18ff.), for example, sees Glaser and Strauss' s (1967) grounded 

theory , Barker's (1968) ecological psychology, Bronfenbrenner's (1976, ' 

1977] ecol ogical experimentation and 1 "educatidnal anthropol dgy/ethhography 

a§ methodologically "similar" to ^riataral istie inquiry., ; Discu§sing the 

relationship of the; last two, he says: ^ " ' ; . 

tOne of the roots of natural i stic .inquiry " is deeply/- " " ■ ••• ,' 
precursor fields of anthropology- ^ ' : 

• ethnography.. That these two fiel ds ^should currently , - 
^ be displaying : a good deal' df vigdr^in the educational " ^ ^ 
• R & D community should therefore come ,as no surprise 1 
■ . ; 'lit is appar^rit;that .a vitgl /i el d .[educational : 
, anthropol ogy-ethnography] is Merging';- one- which orr " . 
principle/is closely of : ' 

naturalistic inquiry (Guba, T97£:2lj. 

Patton (1980:4£), explaining "the rotits of a qualitative research 

strategy /'writes in a similar vein: • }' Pu 




/ derived from, a variety of pKflDSDpTiicar s -_epl$temQT09l- i 
cal ., arid rathdddlpgicai traditions* Qualitative 
methods are "derived most directly from the ethno- 
graphic and ft el d study traditions of anthropology 
and- sociology, ^'or^oefierally, the hoi i sticri n<Jucti ve v 
paradigm ,of naturalistic inquiry. is based on :: r 
perspecti ves i n phenomehol ogyy symbol ic, i nteracti drii sm 
and naturalistic behaviorism, ethnomethodology^and , 
ecological psychology (citations omitted), : 



Thesi statements suggest tftatv while naturalistic/qualitative inquiry 

J • . . ' • • • • ■ . * • . ' " 

and ethnographic research are hot identical , they are at v l east similar in 
method, in fact, however, it is impossible to distinguish, any substantial 
methodological differences between the former and the latter in the writing 
of Guba, Pattonl or most other evaluation methodol ogists who have addressed 
the^ subject.*, Thus , the followi ng description of the natural -is tic- - *' J 
qiralitative approach to ihquiry , derived^ largely from the work of Guba and 
Patton, is equally applicable^ to ethnography., t 

The essence of natural istic/qual itative inquiry, from most points of 
view, is the ex^ni nation of phenomena in the tr naturally occurring contexts 
(c.f. Guba, 1978:12; E^tqn; 1980: 41ff..; Will ems and Rausch, 1*969:3);. Guba. 
arid Lincoln' {^981: 78-80) note that while the experimental researcher 

■ • ' ■ - - /i^-* _ -_' - _ - - j ■ 

endeavors to constrain and control certain "antecedent variables" and 



\ I refer explicitly to the writing of eval uation methodol ogists-f^r two 
reasons: (11 it is naturalistic or qualitative inquiry as defined within" ... 
the field of evaluation tl^at is of foremost concern here; and (2) so far as 
I know, methodologists iin the fields of anthropology or sociology- (the s 
other disciplines of concern here, those most qualified to comment on the 
ethnographic research as such) have not written at all on the relationship 
between ethnography arid naturalistic or qualitative research; , , ; .■ " 
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possible "outputs," al 1 owi ng only selee ted . behaviors to vary in 



experfentally salfent ways* the naturalist strives to minimize th^- extent 



^ to ^wbich both 



antecedent conditions and behavioral outputs are 'influenced 



by ;t^ to Guba (1978: 13), th eru: * 

TH$ natural i 5ti c investigator. . .begins as an - 
: anthropologist ,^ight begin learning about a strange , 

cuTture^/by imrnersing himself in tne investigation . ; ' 

with ; as oj?en a nrind 3s possible, and permitting . 

impressions to emerge. .^Essehtial/ly ,the naturalistic 

inquirer's* model* is ^ethnography-. Jn a more 
* ■ contemporary' vein, the naturaVist might claim his }\ ^ : * • •> 

model to be investigative journatlism; in which "truth" ' - 

can be elicited from partial 'and; even reluctant • 

. , '• > . y v- • ■ : ' ; ••••• • • V^-' 

.'As this shpul d^|yjggest>, iral^ i stic/qual i tati ve i nqui ry is holistic 0. 

'(Guba, 1973:13-14). It strives to- describe and explain phenomena — " \ / v ^- 

situations,, events, programs--- as wholes, paying attention to the contexts J r 

in whic|i activities/ dccur. As Patton* (49a0:'40)- puts it: ; t , : | ;/, : 

In; contrast to experimental desi £ns wfti cjf tnahipul ate ' ; } \ \ . • S 

■J - ariH: ttigasdfe ".tKff- ^^'atl^si^pls' ampng'va few^areftjliy ■ y^ :; ? 7 :';;v'-:'^ 

j- selected -and narrowly defined vari^bles,^ the holistic 1; 1 ^ ^ ; ; -M..- 

\ approach to v research design is open to gathering .data \ Vv : i : 

' V an* ,any number ' of aspects of ythf setttn^ under study i n : ^ :| > • 

ord^r to put| together" a complete pfcture of the. social ; ^ - ; • ; 

A lie of a particular, si tljation or; prd^ram., V i ■ ■ ' ^ ■ 



Natural i sti c/qual itat;i ve inquiry is arl so inductiye In approach Gtiba, ^ 
1978:14; Housed |fe; v Patton^§^4d~4l)iri^^^^ a\/ ; 

^ ...sg,t of pr^e-specified va[;r;i able^ ;3r0 :/ .a'ip^0l5i tl dn^|bpu|.^e1 r • r 



' ■•v relati^ an hypoHhesi s or a conceptual framework..^ Rather, ^ 

aatMr^ brba* general . ejuesti bn§ . 

;> \ v which .are refined Jnd ine^s a? the researctter Observes and. 
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{dimensions al ong which - the data wil T;vbfe:' analyzed emerge ,as the cas£ or v^ v 
. cases Under ; study .are ' gxaffii ried. v'''f. 
v" But while natural TStfc/qualitati ve inqui^y^is incluctive in its 
overall ~desigh»^^ includes both, expansionist (or divergent) and reduc- 
tionist' (gf eonvergent) phases (Guba, 1978:7; Pattbn; 1980:46). tH^t is, 
. the naturalistic/qualitative researcher or evaluator engages in a • 
^ : : reiterated cyc:l e of inquir^steps that consist of (a) gathering, data oh : ; 

* site, -(b) analyzing-, and reflecting upon those data, (c) posing new 
(UsUaily:ftdrS : speoi ;fi c } questions and hunches to guide continuing inquiry, 

i " . 5. - : H^Srf \dT-\\^e t if r h i[ n g' * to ■ "the ."si 4 t:e f s 5 uifder study for further data collection. .. 
''■■'•.,>> Thus, theVe are moments during inquiry when the investigator is broadening 
the inquiry with new or re-formulated questions and hunches and moments; * 
■ v/iieh the investigator is focusing the inquiry in order to address questions 

and/or to conf i rtn or disconfirm hunches. V : - " \ ft 

*. It follows from all the above that the researcher him- or.herself^is. 
\ \V, • the primary ihstmment o^'cfata collection in natural i sti c/qual i tati ve , ]■ 

inquiry. It is as the researcher or feyaluator participates in 'the sitting/ 
' tinder" study, observing and experiencing daily life comprehens i vely^ that * 

the he or she arrives inductively at a- hoi i stic .'understandi rig[ and portrayal 

• — - • ••' > -x^ v s*^- .. "V/*. ' ; •• ■ ' ••■•V . 
v - of the social . ph^ngfnena of interest. V ; - . ■ ■. . ' - : 

; if&Mnote i ! ea r 1 i er , all of the above are also routinely listed as ■ 

Ctl a iTac^enl s tti c so ^ a n t S^i r o p p 1 6 g i c al x e-feli no g r^ap fhati 

' ^{Sp^ridTlr^ 1982: if is directed -toWS^^ of phenomena in : their 

^atu r al 1 y : : dec u r iig c 6 n t ex t s : i"s well knd^rn; as lr Suba himself ^pbi^ts Dut^- ^hd 

' '• ,. ' . -^V • " • ■ ■ ; ^ , • - • • - V ■ ■< " « -7^^* r ' ^ . 
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as Pel to .and Pel to (1978:285) have noted, "one of: the most pervasive 

•• ; ' ' • = — ■ A i — — • • : ' — ■ — 



.features of anthropological culture is the general commitment to holism." 

(See aT^b DobbertT 1982: 5-8; Mehan, 1982: 59ff. ) Ethnographers also see , - 

.their mode of inquiry as generally inductive, with divergent and convergent 

/phases- >Hym3fc (1982:24) had these features of ethnography i n ffii n * wh en he . 

wrote-:: . , ••. • ,,' • • ' : V' ; • • - • ■. 

'For many ethnographers, it is of the essence of the 
;'*■:.' . jnethod that it is a dialectical , or feedback (or 

^Ifferactive-adap is of the essence of 

the' method that' initial questions may change during 
the course of inquiry, ./an essential characteristic isf 
* ;. \ ethnography is' that it is : open-ended, subject to sel^f- 4 ' , ; - 
. •>•. correction during the process of i nqui r& itself r . 

■ Another element o'f the inductive approach has been emphasized by Mehan 
';,V|.; ■ (1982162)': ' ■■ \] . ; /^-' ■ ■ - ■ V : : ;- . ^Jr.--. ^ : Vy^< 

■ : '\: ■■■ :C5tegdrf^s imported to the setting from: the: outside 
f .<:?./'; are avoided. Instead, the. goal of ethnographic re- 

.. . V ;,; of the situation to 

fv : (impinge on thd investigator's subjectivity until the 
: ' . ; : : . \ categories for description are determined by the scene 
:- ; itself. : ' .o'. r " •■ • s ' " ' • ' 5 ^'.- ; 

: ^And finally; echoing another point made earlier about naturalistic- f 
' qualitative inquiry, Dobbert (1982:5) asserts that one "truth about the 

^ basic characteristics of [anthrbpol ogical ethnography] is that the 
^anthropologist's entire person is used as the jjnmary instrument of 
: * research ~" • • . -.. ■ * •. . . 

: # . ft 'shpul d ^be evi dent ■ from- the- description ;. and citations above that 

; .the general fnethodolo-gicai principles; of natural istic/qual.itati ve i nquiry I 

• •• • '..*.• y ' • _ • j_ j ■ _• ■ ■ ■ . • _ 

. in general ancf^of anthrdethnographic 'fi el dwork in particular are virtually. - 

•v -Videntical. : Furthermore, .tlie twp also hav.e a common,, philsop.hic'al . : .v 
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foundation: a phenoj|feife1ogica1 perspective. To^describe this per sftecti ve 3 
both Guba and Patten feite v ?ogdan and Taylor's {1975:2} Introduction to 



Qual itative Research:^ 



... Two major theoretical -jprfSpectives have -dominated the ' 

social science scene. ■ O'ne^ pdsitfvistn ^ traces its ■'- 
■ : -origins to the great social vth.eori sts of the ni ne- 

• te^nth and early twentieth eerier ies and espec i al Ty to 
; Atiguste Conite and Emile EWrkheini^ 

* _ seeks the facts o r causes of • soc tal e n omena w.i th 
;/ little regard for the subjective- states of indi vict- 
uals. .Durkheim advised the social scientist -to. ■ 
consider "social facts," or social phenomena, as - _ 
"things" that exercise an external and coercive force 

iv .... * oil human behavior, V 

• The second theoretical perspective, which., foil owing - 
\ ; the lead of Irwin Deutscher,' we W*ll describe as , . 
: pfenomenological , stems most prominently from Max * 
.. Weber. I he p.henpmenplogist is concerned with under- 
- - v.sta from the actor's own frame of / 

: - - $i rice the ppsitf vists ,and the phenomenol ogi sts ;ap- 

»ent probl ems and seek different answers » 

iifferent methods. 



ologies .(quoted in Guba, 1978: 11-12; and in Patton,. 
1980:45; italics in the original). \ . v ".". ;>' 

Both authors go^on to explain what the phenomenol ogical .orientation, V/;. 

as defined here, implies for natural istfe/quai itati ve inquiry. They point X{X. 

cjoui that the natural i stic investigator is interested in the meanirjg of y;;Sfy h, : 

behavior for participants in the * setti ng under study tPa^bh, ^1^89 • 4 4-45 5t : ■ . 

" While' conventional,,, quantitatively oriented inqui ry, seeks a single real iVty - 

--that which is vein Fable, as rt f act" though tHe*bpe 

or quasi -experimental research-- naturalistic or qual i tati ve inqtiiry; seeks 
. arid expects .to find many realities: ■■■p ; -\ : 'xx^rx'\ 

\ '^ef : >*atii^- wi th. whi ch. the natural i stip i nquirer must ; . : V^:^ ^ 
deal exists only ^ people and 
depends heavily on their separate; perceptions.^ It 'is: , ^^ r :--X -i'-v^X/, 
. not. surprising that their v.iews* of reality should 7 .;, ?x : ;r. 'XXr:;x'' : y : -^ 

; ! . l^iffer (Guba^ W&ith^'i>' : :'- ^^^^^--^^^^ "<> 
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Elsewhere, Guba" and Lincoln (.1981: 133). Cite Erving Goffman's (1961) comment 

that."any group of persons. . .develop [sic] a life«,of "their own that becomes 

mean-i ngful , reasonable 1 , and normal once - you get close to it," adding that: 

rt""i^"' the total i ty of this; meaning, "reasonableness , ' . : 

and normalcy in each context .and setting that the' 4 - 
naturalistic inquirer ;seeks to understand, to explain, ?' V\. 
.and to describe. .• - ; - : "' "•' * ' 

Taken as stated, the latter is a goal' with which nearly all anthropol ogists 
engaged~in doing ethnography could readily share. They, too, take a 
primary interest in the world as experienced and'uhderstood by members of • 
the group that they are studying. Indeed, "for ethnographic inquiry, •"; 
validity is commonly 1 dependent on an accurate knowl edge of the meani ngs of 
behaviors and institutions to those who participate in them" (Hymes, ; 
1982:25; and c.f., Erickson, 1978; Pel to and Pel to, 1973:60ff.; Pike, 1967; 
and Mehan, 1982). ^ . 

To. summarize, naturalistic/qualitative- inquiry and anthropological 
ethnographic inquiry share both, a philsophical base (the phenomenol ogical 
perspective") and a body of methodological principles. Both entail the 
holistic, inductive (or dialectical, or responsive-adaptive) study of 
phenomena in tnei r natural ly occuring contexts. Both pi ace emphasi s upon 
• the investigator as the primary instrument of data col lection, -immersing 
, him- or herself in the setting under study and attending to social 
realities as they are understood and experienced by participants in that 

setting. • ;.. : ' '•• • '•• . V! ■ 

A Fundamental Difference ; ; : 

: Despite their several similarities, however, anthropological 
ethnography '.and* naturalistic/qualitative inquiry are not identical . The 



latter is a generic label for m approach to inquiry ; it is a body of ■< -,' 
; * Setaphysf cal ; and; epi.s temol dgi cal as^urnptidns wtth ah allied mode of inquiry 
. ^ • . ;Wh i cH,^ .1 i.k e the .experimental paradigm* is separate front any disciplinary 



f^ ^ftsglf eil%ai1 s no conceptual -system 

phi 1 osophi c stance ;^ i t preseitt? no theory of the general flafrum o^ -V.; 
~ organized~human social life as it is carried but and experienced by those 

^ under study . . Anthropological ethnography, on the other hand, provides 
tjieory of this type —theory whiqh is grounded in empirical studies of 

' culture and cultural process. And therein lies the principle difference . 

between it ana naturalistic-qualitative inquiry in general .. . is ". 

This** difference, I maintain, is an extremely sighificaht one; for, 

as Erickson (1978:lijias convincingly argued j "...narrative description of 

social relations always contains within itself a theory of the social 

events it describes; [thus] no description is mere description: 11 

* the theory entailed in a description of a connected se- 
quence of events across time is in essence a theory of its v 
social organization... While descriptions- may or may not 
- also entail theories of psychic processes within individ- / 

uaTsr-tHedries of motivation, temperament, learning or 
cognitive stage — descriptions of events involving the - 
actions of more than one individual , I maintain, always 
. v entail theory about the organization of social relations. 

This is true even when inquiry does not -proceed from an expl icit, 

pre-specified, conceptual raodel of the educational program or other body of 

human activity under study. Why? In order to produce a description of a 

■ . program (which is at least in part what naturalist evaluation 
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inquiry purports to do), the naturalistic evaluator must make decisions 
about when and what to observe, about what to. ask of whom and how to- ask 
it. He or she rust also make choices about which 'of all the phenomena 



: ' co^occuri ng from moment to lomefit' in the scenes •• Chosen :f or observation to 
#. '%'ote dbwri'^r otherwise ddctimehiJ Similarly", he\or'.she mus^f sel ect. 
; ..remarks, among all of those that occur in casual conversations on si^as 
' ';' . wel 1 as i n formal i nterv'iews , to attend to and" record. And as i nqui ry - 
proceeds the evaluator must sel ect which behavior, terminology, etc he/she 
can safely treat as unproblematic, its purposes and/ar meaning understood, 
and which- he/she should. treat as problematic,- its .purposes and/or meaning 
requiring';. explanation and disambiguation by actors in the scene. In the 
< naturalistic mode of inquiry, these decisions come to be informed, as 
inquiry proceeds, by the accumulating data gathered from the site and by 
the questions and and analytic categories they progressively suggest. But 
they are al so recurrently made on the basi s of, and thus the accumul ati ng 
data always reflect, the evaluator' s perspective on what is important. It 
is in this 'sense that all inquiry and all inquiry -based description 
proceeds from seme point of view: some theory of the phenomenon under 
study, of how it works', and (therefore) of what is important to look at in 
studying it. Ultimately, /- . 

the theory of social organization entailed in description 
is embedded in the key terms \r\6 relations contained in the 
• description; in the very nouns and adjectives one chooses 
as labels for the cast of characters (statuses), and in the 
verbs and adverbs one chooses as label s for the kinds of * 
'actions those characters perform together (roles). Such 
• theory isr-glso embedded in the descriptive syntax 

accounting tor the sequence relationships among actions, in 
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the points of functional cliiriax dr. cn sis identified in 
those sequences, and' in th§' terms 'iritfi eating- standards for 
'judgment of the sbcial; appropriateness of thoke actions 
(Eriekson,.19ZS;5)- : 

•; Thus, , the theory* of social organization and/or social relations that 

dne imp! ici tly :: or feftly, selects afffects how one target 1 s one 's ioflui ry 

■Md structures one' s : 'Mpaht of hu^|n. endeavor of i nterest . It fol lows 

that: • 'i'r- : 

" ; " - the problem Is no|" the elimination of "bias" in description 
' : ...rather the problem is the selection of "bias" —or 

theoretical frame-- appr-opri ate to the research probl em at ; - ; ' ; ' 
"•• ' hand (Erickson,. 1978:4) ' : • • 

The general research problem at hand in a naturalistic or qualitative 

evaluation is typically: (1) to identify certain aspects of. locally 

situated social: organization —actions ancMnteractions which are, from the 

actors'' points of view , routinely related in some way to the social program 

or other- innovation to be evaluated, and (2) to understand, describe, and 

explain these actions in terms of the - actors* social' realities. A. theory 

appropriate to this problem must be a theory of how , in general , members* of 

social groups organize their activities in light of their perceptions and 

'interpretations of the people, behaviors, and things in their world, thus, 

, it would provide a set of principles for determining where to look, what to 

look for, and (consequently) how to structure looking in order to identify 

and gain data on those locally situated systems of meaning, belief, value, 

and action that are functionally- relevant to and constitutive of the '; 

particular program or innovation under study. Such a theory, then, would 

be a theory of social organization at an "intermediate" level of 

abstraction: one which lies somewhere between and links (a) the general 
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phenomenologiUl proposition that people do indeed act in terns of the 
meaning that phenomena have for them arid {bj a specific account of how 
persons in a particular setting do so,* _ 

It should how be clear why the absence of such a theory is 
significant 'in an' evaluation that is .intended & be naturalistic or 
qualitative. The naturalistic/qualitative' inquirer is enjoined by . 
evaluation methodologists to understand .and explicate aspects of social 
life in light Of the ways that participants in the setting understand and 
experience them, But in going into the field he or she has no system of 

constructs, for defining and locat ing participants' realities or meanings: - 

' ; : ' ' a. . _ ■ /' 

for determining what they are, where they are m anifested or displayed, or 

how they function in relation to the daily activities in which p articipa n t s 

are engaged. In such a situation, the identification of participants' 

social realities and notions of meaning becomes, at best, problematic. The 

e valuator cannot avoid making implicit and explicit choices about what to 

attend to and treat Is ■ data in the course of fiel dwork. He/she cannot 

avoid decisions regarding w|at questions to ask now and next when on site. 

And ultimately', in framing an account of the program under study, he/she 

cannot avoid selecting among alternative ways of describing people, beliefs 

and values, actions and things, and how 'these function in relation to one 

another. In the absence of a general theory of social relations to help 

guide these decisions, the evaluator can only fall back on his/her own 

intuitive notions J orP some body of research findings, on theory from some 

academic discipline (pol itical science, economics, psychology, etc.) or < 
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some combi tration of these 1 Whichever the -Case,, the evaluator's inquiry and- 

• • • . ■■■■■ -' . - : , » a * : V'"'.. 

account becomes structured by the premises :of the theory/ cHoseru rather : ;.:;>'.; 
in terms of the social realities understood and experienced .by membens. 



of the group under study.* Then, t\\e ^ v-; 
natural i stic/-qual i tati ve inquiry is -undercut; it becomes mere, on-s'i,t£ data ;;* 
. col 1 ection:. the description -and explication that emerge from such inquiry ■« ' 
are invalid, for in natural istic/qual native' inquiry valid description and- „ v ^ 
explanation are those which in their, vocabulary and syntax £ake accoiuit Qf ; ; i- 
and clarify the socikk real i ties in terms Gf wfiicK part1|tpaif&5- in: the , . . v 
setting tinder study a"re acting (c.f., Erickson, 1973:7; Hymes_, . : ; • . 
1982: 25ff.). This loss of validity is especial jy troubl i ng * iri 'information , 
that is intended as a basis for action, as is usually .the -case in an I . . 
evaluation. If the .accouq^ of the program or other endeavor under, study ' , 
does not accurately portray the world as participants knoiTit —the •systems 
of meaning, belief^ value and action in which <and with which they routinely - 
operate; participants are very likely, to reject the account as >a basis for _ , 
action. Alternatively, the consultation of such' a "report by others can -\:^1:;ff- 
lead to erroneous- action: action which makes no sense 4 n the World- ^ ':' 

.. .. . _ •; *■_•;*■_'- -t 1 ■. l. ... 

participants know, which functions in ways, counter to decision makers' 

intents', etc.- ■;• ': ' . ;"• ' I '■■ '' : ^;K-'\'^^i 

k This -is not to suggest' that eval uation accounts must be written on^yX in 
terms of the social realities^ and nations of meaning of the group under^, 
study. Frpai an ethnographic perspective, however, the description and 
analysis of a prcgram shou.ld at least describe and explicate the program , 
from 'the perspective of participants' realities. Then, the eval ua tor can : . -. 
no on to oresent an" analysis -from another point of view, i.e., from the ' . . 
perspective of seme social science theory that seems hueristically strong 
in light of. the -data. ' . • , ' ; " : : - ;S 
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Monp of 'these problems are eliminated by an effort to enter the study 
t s.etting.withoyt preconception or bias, ior can an evaluator or researcher 
ascertain participants' social realities or notions of meaning simply by 
ask i ng r f i cjo r ou s 1 y op e n e d -e n ded questions and observing in formally 
: whstraettilred Ways. The social meanings and social functions that kiydstif- 

: ' i '_ • • .," ' •• ■• -.^ • ■■■■ : : - •;■ > ■" .-. w . " ■:■ " . - •• v - v v'"..'*'- ..'-:> 

persons, actions, w routi nely have^for parti.?j pants vdp no^^ 

laap olit of interview responses or? from "tfce^ stream of; observed behavior; 
7'Thsy aH discernible in naturally occurihg behavior, but* only, through Some 
set of analytic operations, operations which are predicated upon some 4 
theory of how organized social life unfolds. 
; > In s;ummary, naturalistic/qualitative evaluation as it has been 

described to date lacks a theoretical perspective on how groups of persons 
• order ^heir social lives in terms of their social realities and notions of 
meaning and so assemble the everyday activities which are recognizable as 
"the program' 1 and /program effects" that are the subject of inquiry. 
Because it is routinely directed by such a theory, I maintain, 
anthropological ethnography is^a,more powerful tool in those evaluations 
undertaken from, a phenomenolog.ical perspective. ' 
V- " ? In the ^51 lowing pages^ | offer support for this contention, 
presenting a theory of social organization b^sed in anthropology and 
related disci pTi nes and illustrating ^ome of its implications for 
evaluation inquiry. * - 
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A Coristititive Ethnographic Th'eory Of Social Organization 



Ant'nropo.l ogy i*! not a field with a single perspective on jthe ordering 
of human affairs; It embodies many different .viewpoints on the .nature of 
cul ture arid social organization.' I present only one of tHfse.here, dne . 
which is'' most closely ti ed "£&)Z%i tut;ij|- 
^thi&gfa^ 1982), Other theories derived from . 

eth n dl cgy- 1 the- body 7 of Knowledge on culture which is the theoretical 
foundation of anthropology) would suggest different directions for 
evaluation inquiry, but this one seems to be the most adequate one ofr 
describing and explicating the dynamics of social programs. 

This theory has its foundations within the anthropological 
orientation usually called "cognitive anthropology," as well as in. the 
related fields of sociolinguistics (or the ethnography of comiiiunicattffn, ' 
e.g., Bauman and Scherzer, 1974; Gumperz and Hymes,. 1972; Hymes, 1974) and 
ethnomethodology (Garfinkel, 1967; Mehan and Wood, 1975). As I have 
indicated above, it is a theory of how group members generate and sustain 
organized social relations and of the role members' perceptions and\ 
interpretations of phendmena -(their "realities") play in that process. \As 
suc h, it includes a number of interrelated premises which elaborate the 
fundamental 'phenomenological axiom that persons act in terms of the 
meanings that persons, actions, and things have for them. I list and 
explain these premises first, ending with a description of social 
organizational process. Then I go on to consider the .implications of /this 
t't&ory for evaluation inquiry. . ■> 
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Basic Theor-etf cal^remi sesy 

: t A fipst, fundamental supposition of this theory is that organized 
-social Tife is permitted by some set of operating principles, held Tiiore or 
, for deter^hing what behaviors and things mean- From the 
/^^p^r^ f ^o^SQBie "cogni ti ve" : ah threpol ogi sts , these mdre-or^l ess shared 
^ a group 1 s cul tured In Gobdenough v s (49.64: 367) 

: terrris:!;' : '. : ^; •• 



As I see it, a society's culture consists of; whatever- 
one has to know or believe in order to operate in a ^ • ; 
manner acceptable to its mSmbers, afid to do so in any 
role that they accept for any one of themselves. 

Elsewhere, culture has been similarly defined by Goodenough (1971:41) as a 

"system of standards for perceiving, believing, eval uating ajid ^acting. 1 ' 

From much the same perspective, ppradley (1972:29) has Written of culture 

as founded in a set of cognitive ru3es: "...instructions fo> constructing, 

combining, interpreting, and .otherwise deal ing with, symbols." From these 

"rules," Spradley suggests, are built cognitive maps (taxonomies or other 

classificatory schemes of kinds of people ..things, social situations, 

etc., e.g., Cole," at al . ,1971:51-91; Frake, 1964; Hage, 1972; Tyler, 1959) 

; ■ _.• _ • ' « . : _o _ ■_ __ , 

and also plans (cognitive "programs" for sequencing a series of operations, 
over timefc.f., Miller, Galanter, and Pribram, I960). • 

Sociolinguists see this same kind of sociocultural knowledge as the 
basis of a" "speech community" (Gumperz, 197.2; Hymes,1974:4ff . ) ~a group 
that holds in common not only a language, but also a body of rules for 
determining the social appropriateness and social meaning of various forms 
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corcuTiuni-cative forms of behavror. Similarly, ethnomei'nodol.ogi sts 
[ . . maintain that members of a social. Unit make s$nse of^thers' behavior by' <• 
'employing shared (or presumed-to-be-shared, Cicourel , 1974a:34); "background 
Understandings" .(Garfinkel , 1967) and "interpretive procedures" (Cicourel , 
..1974:51ff. and passim; Meharr and Wood, 1975: 98-115) . . > . ; «... 

.' f In short,, some body of sociocultural- knowledge lies at- the foundation 
of and facilitates social life. In general, this knowledge can be ' V 
conceptualized as a series of generative principles for making sense of trie 
world and acting sensibly in it. ' 

. This initial premise begins to flesh, out the notions of '"rjeality'-' and 
"meaning" which are so important to pheqomenologically based inqjiiry but so 
incompletely explained in works on naturalistic/qualitative evaluation. 
; It should be apparent that the "realities" of primary interes^fto 

ethnographers are not those which abide idiosyn critical ly in particular 
individuals, but those Of societal groups.' furthermore, these realities 
are not random or isolated bits of perception and interpretation; rather 
they. are systemic in nature: coherent bodies of perc^tion and belief, sets 
7* of standards for interpreting Wnd acting,, which recurrently and routinely- 
• guide group members' activities. 1 \ 

; To reference the systematic bodies of sociocultural knowledge that 

members of a particular societal group use to organize their perceptions, 

v • '__ _ , - - - - - ' ■<_ *_■-.•_.< 

interpretations, and actions, many anthropological ethnographers Use the 

term emir, which they constrast with the term et'ic. -In this dichotomy etic 

constructs or accounts ^onsider phenomena from the point of view of t . 

| standardized reasurement ("or if not in terms of measurement at least in' ; 
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« terms of systematic' vay^ i n^lth scTenli s.ts '^external -obsarvors deffne, .• 
;• ■ units" EricR'son, . 1 977: 60) . * .'Ernie constructs' and accounts, on the^ other 
U j|ndi/#e i tti&se *df traifordiWy actor in the . ?e tting ^under study'. . Erickson 
, (1977:60) uses the cpneepts. "stature" and '"height" to -i'l 1 ustrate th#, • , 
yp; t ^tVc-efnic~ ^i;stinctidn : .At the same time, his -remarks •1nW^^fe i k^%9f ' * 
. ';i|'^syt^ms: of'' Standards W 

•>• \ %hich etlinbgfaphe^ are typically interested. ' •.' • > y - ■' .: 

' - v In everyday interaction, for example, people- may treat the' ' • 

; •' phenomenal ly eonti nuoiis • van" abl e ' of height ^ i f : i t were ' j f ., 

' ^ > discontinuous, categorizing people as short, average,. and _ ";. '• . 
: * tali in stature-, v Unf.ts of stature, thenji waul d be social ; ; : \ 
: -:'".h-- /Facts, [i.e., emic categories] "defined in terms' oF people's - r , ; \; .. 
' ' J discriminations of thresholds and the actions" they take . y:,,;^ 
[• - : v toward each other" on -the basis;of those di scri mi nations ., r-^; 

The 'continuous variable height 'could be measured , formally ^ ^ ;«.••. . 
^ '. by .an arbitrarily defined unit such as the; inch or . ' :_"J ^ 
'''■'■> mil-limeter, capable of reliable -use by observors in making . ; 

, * 1 ow-i nf e rence j u dgnjents . These unit** of description could ■%• <■ 
\ be used, in' valid and reliable ways within a system oR " . . 
.technical categori zati on. • i ndep'endenf from 'functional , w ' . 
j categories of, discontinuous "chunks". used by people.in- • - _ : ';'V 
.' thinking. of stature... , t j_ : ■•'■^■, ' " : i ; ; " 

, • Modern anthropology, .socio! ogy #- an,d -linguistics have Shown ^, ' v 

• >..■ a;- great deal of- variation amoiig l^uma/i groups ^n the emic r • \ ; 
" ; r ' ■ diScHmi nation ". "' £r^-_eni-i^''-' sa.i ..TetiiceTd^f" pbysl b^j. '. and social - :' : • . 
' i f- phenomena.' ReseaVch'ers in ih&se ^ disci ^^pl.iTies^Cari stafie; :: : • > 
'• systematically what is emic ih everyday* We rits and: how, * 
•-. v people. take 'action with regard, to the^emiV From .my- point v 
' of view„ this is what is qua! itative about research ' ^ 
' j.. v 'statements of the qua! ity of things 'and relations s .- , - 

( : descriptions of events in functional terms'. ; *v . ' 

'.Put another^way, anthropological ethnographers,' interest 'in how persons -in 
a : group systematically orde'r their social -lives directs thetr attention 'to 
the emic categories- 7 (and ways "of distinguish!" ng among categories, evg.,. or 
„ -stSture) that greup members: vroutinely ^empl 6y ^n3 ? $S the act^On^Shieh 
] members' routinely, take on. the'basi^pf these categories. Thus, ;the . 
•: "* s •;-.'■ i»« * „, .... ' b . ' v .' ';'';>;>...-' ^ .•• t> v '-, i?; 

.'•■-•■..•' ' . ■•" -<i'.- ; w. V----^..^;;^ >:;V 
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^meani ng".1n : ^ whfch 'Vthnagraphers., ar^, : fflqs^: te^^:ste : a ; is social :a ma 



the functional, significance that ki nds of persons, (statuses-), "actions, and 
things recurrently ■ and rountinely have for group members,, as manifested in 
'*< r bitfie^'rnds'' o^'MtT oris :they ".routi riSfc': take,w W' respe'ct . to them.* ■,!<,. 
v •/^secon"d'the*oretical premise' fur%he^;e3ab*af-ates the fundamental ^, 

•;fij-y,/ / ' : « ; -/^ ;. >■ ; ■■■'} ■-- '■■' , ■ 

i ^ notions of. cul ture Cor. social 're^fJfty) and' n^Q|l^;^i^-|p^''i|i^« ."^Ifii s : 
.C:w:ts the ■.premise- that: a jolaffig ^outi's st a rfdards for sen sibly and " . 

:^' :;: 'i.v'»Sr?% ; ■ •••• - ' 

'.app Pop r i a teVly i ^tei^pre ti n g phenomena j ^scnbi ng' meam ng and ^aXue^and y , 

^situatitfn^ ^ays of'^ for example, can change . 

. -;4r^i1iatical'Ty- from one? social ^context to another. (Consider the thresholds 
If #:ii^(f :. , ia1.t* : in3 i *^1^t"vtliat come i nto pi ay -Tn ^ choosi ng astronauts and those 
used in, selecting college players in the professional basketball draft.) '• 
; S'imil,ar1y, ways o-f appropriately -making sense of a particular form of 
' ''V :' behaviOr'can vary from- situation to' situation. (A students rai sed hand may 

. ^,'-v ... • \ .... . .. . ' ' ^ 

^•^?^n.% ; waht the tlacHer 1 $ -re^ogp i ti on " at one moment, "I volunteer to do a 

-■V • . _ ^ . j \ s v r ._ ■ r - t •- • . -- _-- - - 

^' ; pf obi em at the board'- thki jrtext, .*nd "I have an answer to that question" *at- 
' ' still ao^^#^ ^%r^o^ of behaving may; Be appropriate 

jn 4 pae context and r inap0o^iate in another just a second or* two later, 
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^' ^ T|j^ iloes *nd^ 'mean that ethnographers are uninterested ip the' literal 
. ^ f efei"enti&l "mearfi ngs of words, gestures, etc. for persons in the group* they 

• . 'are^^ifiwg. " (Hym^ 1982:25, for example, gives two excellent /,_ 
$Z : f 1 %u^Vrat^onsi- of ^ the importance of knowing loc&Llexicons. ) Rather, the 
C vj^tot here 'is^hat ethnographers' inquiry usually focuses on those aspects 
>oc " oKi^aning that go beyond the literal- It is what things mean in 
Ch. ^f mlcpbrial i|erms for societal members ^that claims primary attention in ; . 
i : ^ ; ethnography • - , - 



ERIC 



0 

ERIC 



e.g., helping a friend solve a math problem just before the test; helping 
or her a Fter the test has 



... j v ■ t •: . ' r ... ,. r 

The definition of -social context (or social situation) intended here_ 
is a very* specific one. As construed by ethnographers, especially con- 
stitutive ethnographers, context refers to afi • i ri terpretati o h " of "whcr we are 
and what we are doing now" which circumscribes or frames the set of 
alternatives from whieh participants in a social scene make their next 
choices about what to do socially "now" and "next" (Batesonj 1972; ; 
Cicourel , 1974b). Thus , contexts or si tuations may be nested one within 



another at various 1 evels of interpretive generality. 1 For exampl e, a party 
in interaction may interpret the si tuati on now as "a moment of ■ * 1 . 

mi sunders tfcndi ng m a casual soci al conversation ^ith a colleague during a 
break between classes while at school when we first began to try out the 
new curriculum"; --if he or she were to articul ate . an interpretation in so 
many words. Each level of contextual interpretation can entail reference 
to some distinct (but rel at fed), sets of sociocul tural standards for 
appropri ately interpreting others 1 behavior and sel egti ng ;one 1 s own 

. actions. ■ ■■ "'.'.'.V' : - . • ■ ■ 0 . ' {'"■' ..' 

. x When one. joins the -view> of social context stated here with the 
definition of cuTture given above, it follows that "culture ceases to refer 
to a generic phenomenon of study and refers, instead orjly to some level of 
that phenomenon" (Go,odenough, 1975:4). . That is, the cjilture ^of any society 



i as a whole— its "maerocul ture"--is a broad level of ^ganization 



integrating. numerous situation-bound cultures:* 
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Every human being, then, 1 ives on what is for him a multi- ; 
cultural world, in which he is. aware of different sets of 
others to whom different ciil turat attributions must be made 7 
I .and different contexts in which the. different cultures of 

■ which he is aware are operative. His competence in any one . 

of these is indicated by his ability to/interact : m - 
. : -effectively in its terms with others who are acknowledged . ■. 

as' al ready competent (Gopdenouglv, op.'' cit . )V ' • . .- >v-.v.'% 

;:..;i:i>;.v; yv^.in summary , cul ture { or sb'ci al real i ty ) Ts mul ti -1 ay ered . A societal 
systems of standards for perceiving, believing, evaluating, and acting ; ; - 
varies with features of the social context or si tuation --features which" 
are themselves i nterpreted by group members at various hierarchical level s. 

Vy : /\£ Th'e perspective taken here njns counter to the widely held "folk" . ; 
' \vi ewpoi nt that associ ates culture exclusively '.with; groups of common . ' 

■'.';• gebqraphic origin, i.e. , with national i ties, ethnic! ti es , 1 ocal i ties , etc< ; 

\V*' ■■■■■ •.•:'•':.•;• ' ■ .'■ y ' ' '■ ' '■ ^'c-.'S- : • •'■."• : ;;;..-- ; . ■ 

It emnhasi zes that withi n : a gi ven geograph ical boundary —within a regi on, 

. community; or school , for i nstance— cul ture. can be distributed such that : ." 

, some standards for 'perceiving, believing, acting* •• and eval uati rig are shared 

by al 1 or nearly, all ; others* by many; and still others, only by members of 

certain sub-groups. At .the same time, one mi ght f i nd that persons i n 

•• "iWi d'ely separated si tes share some' features of culture. • (One can .make a 

••- case, for example, that there is a "teacher .culture" and al so ; a 'culture of 

. schools, e.g., Sarason, 1971-> Thus, if studying; the "real i ties ''.-of actors 

in a setting does not mean studying' individuals ' idiosyncratic viewpoints, 

neither does it mean taking for granted that all participants in a setting 

know and- experience reality in identical: ways. It encourages the ■ 

ethnographer to look for' sal lent 'emic. contexts --those that' participants in 

the setting under study routinely recognize and act. on-- and to- examine the 
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systems of, .standards for seeing the; world arid s taking attidh in' it that 
participants consistently , systematical ly draw upon in^hose contexts. 

'"Implicit" in the theoretical tenets presented thus far is another that 
.deserves expTici t mention : in the view taken here, the culture (er social 
reality) and behavior of a soci al group are i n constant, dialectical 
relationships In "a process' that goes on continuously In, real time ai , . .. ; 
group members conduct their everyday affairs, culture informs action and 
simultaneously action embodies and manifests culture. That is, as persons 
interact with one another, they draw upon and use their sociocul tural 
knowledge —their notions of lands of contexts, people, actions, and 

things; their systems of beliefs, ideas ,and values; the% standards for % 

•< > ' - . " ' ' * . ' ■ Jq - ■ V V > - ; - f ' 

interpreting others 1 behavior appropriately and choosing appropriate 

actions in context. And as they dravi upon and use this sociocul tural : ; 
knowledge, their behavior becomes patterned in certain routine- ways. Thus, 
patterns of behavior; are constructed in interaction; and in the behavioral ^ 
pattern i'ngs that they routinely construct, group members display their 
sociocul tural knowledge, projecting it .(and the social meanings and views 
of reality that it entails) onto and into the world* making it available to 
others ? and so generating and sustaining it. • • , • 

'it.-follDws that culture'is' not purely. subjective, not solely^^ 
cognitive or mental' state existing only in, people's heads. Nor is culture: 
. exclusively objective in nature; it is' not only "patterns of behavior" 
existing "out there" in the world. Rather, from the perspective of the 
constitutive theory of social organization presented here, culture (or 
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social reality) is ihtersubjective: a social phenomenon hot only in the 
sense that it is of or pertaining to society, but in the sense that.it is 
by society, i.e:»., ; . produced and maintained conjointly by group members.. .;. 
Put in Mehan's (1982: 64 y terms, the constitutive ethnographer treats ' 
cul ture as "intersubjective praxis (human productive and interpretive 
p racti ces) instead of either a subjective state or an obj ecti ve tin* ng." 
•Thus, it is appropriate to view 

v ...the objective facts and subjective states associated 
with education, like those associated with other cultural 
■domains, A re interactional accomplishments. "Classroom 
-^organization," curricular programs," "teacher effective- 
ness," and other so-called "bbjectiye" aspects of schooling 
are "intersubjective phenomenon, constructed in inter- 
action. -Similarly, ''students' abilities," "students' ' 
intelligence," "teachers' styles," and other seemingly 
subjective states of individuals are intersubjective 
- phenomena, displayed in interaction (Mehan, 1 982:64). _ : . 

A Theory of Social Organizational Process 

: Inherent in the premises explained above is a theoretical model of 

social organizational, process. The model describes how such 

intersubjective features of social organization as educational programs are 

constructed or "accomplished" in interaction as participants draw upon and 

use their sociocultural knowledge (or, their socially, generated and 

sustained conceptualizations of reality). < I review this theoretical model 

' below, then go on to explain some of ltsiiiiairi /ii^11cat18ns-fdr:^:aeM"}W--'. 

^X. i --' - ■■ ' '•' • : : ; : • ' 

and conduct of evaluation inquiry. . . 

• • . . ' . • _• _ ' ; '* ; ■' ■ ■ . . ■;• -i ■ ;" . 

Participants in face to face interaction perpetually scan the scene, 
taking in a plethora of perceptual "data" (Spradley, 1972). They routinely 
gather information on -the time, location, and personnel, present (Erickspn, 

o 
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1 971i Gdflman, 1974); and ^they * attend -to. brie another actions- As 

^^Me^erm^^^ 

each other- The .behavior of all participants in the scene, enacted through 
many behavioral modes "■'■"simiii "t-aiieSusiy i" bears '. i nf 6?roati ori'-'-'f 6P"^eaeh other 
participant about, the evolving definition and/direction of 'the social 
. situation at hand. Lexical, syntactical, and parali nguistic behaviors can 
carry meani rig * So, too, can gaze di rection, bo<f/ orientation and posture, 
interpersonal distance, gestures, and so on. At any given moment, a 
person's behavior in .ail these chjannels can contribute to the total 
"message" he or she is seen as sending at that moment. (See Dorr-Bretfroe, 
1982, for a comprehensive review of research supporting these points.) 

Drawing Upon upon -sociOculturally based systems of standards or 
background understandings of the type noted above, participants in the 
interaction encode, organize, and interpret the perceptual; data they are 

constantly receiving: they make sense of "who we are and what we are doing 

•■ ' ' : . / \' '•_ >i_ '■■.r- / _." • - 

now" (Cicourel , 1974; Goffman, 1961; Mehan and Wood, 1975: 102-1060). But 

• 'e ', _ - _. . ■ . . . '. .... . 

even given an adequate practical knowledge of sociocultural standards, what 

particular behaviors, objects, etc. mean in, context is hot unproblematic 

/■ , ■'" /I. _________ ■ ■ 

-for participants., 'From an ethnomethodological perspective: 

': '.: all symbolic forms [rules;, vocal utterances, gestures, .•>. 
actions, things in the setting] carry a fringe of 
• ' incompleteness that must be filled in, and filled in 
differently every time (Mehan and Mood, 1975:90). 

For example, in speech we never say all that we woul d be necessary and 

sufficient in order to be understood by a person who knew nothing about our 

social world. We assume knowledge on the part of "others; we expect them to 




be able' to fill in around what we literally say in order to understand what 




waJnpan, T n do th is filling in, persons draw upon; their sociocultural 

knowledge, their understandings—understandings that include more-or-1 ess 
■ * ' ' ' .. / ^ _ ■ 

rough cognitive maps and plans of how the social world is organized; 

* ** • ' 

"facts" and assumptions about what things ar;e, how they are related, etc.; 

as well as rules for behaving arid making sense interactionally. But, 
because each person has had experiences of and in the world which are 
sl/ghtly different, because sociocultural knowledge is differentially ° 
/distributed among members of a society (Gearing, and Sangree, 1978; Wallace, 
1970), arid because the social context at the moment can be /differentially 
"read" (e.g., Erickson, 1975), persons may each do the filling in 
differently than another would and differently than'' the speaker assume 
others will. (See Garfinkel , 1967: 38ff. for additional explanation and 
illustration of this point.) 

Thus, sociocultural standards (or understandings or rules) do not 
• "tell" participants in social interaction how to make sense of others' ; 
behavior or what the situation is now; they do hot "give 0 " persons 
interpretations of social phenomena. Social life is too fluid and varied 
to warrant such a construction. Rather, sociocultural rules, maps, and 
plans should be construed as' a body of resources upon which participants 
creatively draw in making sense of what others are meaning by what they 

■' do* > 

Simultaneously, of course, as participants '"engage in thfs work of 

interpreting—attending to and making sense of the scene and others 

• •• " * 

■ ' ' ' - ' ' " / •■ ' . ' ' ■ • 'V ' 

0 
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emerging behavi of —they themselves are also' acting; As they interpret "who 
w p are and what we are doing now" from mom e nt to moment, they are 

perpetually detenmpTng now m ayclriiFpro^ ' . — — „ 

interpretations and given their social intents at the moment, i .e., what 
they hope to achieve by what they do. And they act perpetually on the 
basis of these determinations. Just as sociocultural standards do not tell 
persons the correct interpretation of others' behavior, they do not mandate 
what* specifically, is appropriate for a person to do at a particular 
moment in interaction. 

As Cazden (1974) suggests, interaction is ordered along two basic 
dimensions. It is ordered sequentially across time in relationship tor 
actors* social intents and the ongoing stream of activity in which actorsj. 
are engaged. This Cazden refers to as the "syntagmatic" dimension of 
interaction. (Thus, "one can speak of syntagmatic rules" or rules of 
"horizontal co-occurrence," Ervin-Tripp, 1972.) Along this dimension, at 
particular syntagmatic moments, participants have options for the ways, that 
they ean appropriately express- "their intentions. Those options constitute 
the paradigmatic dimension of social interaction. (Thus, one can also 
speak of paradigmatic rule's, or rules of vertical co-occurrence and - 
alternation, Ervin-Tripp, 1972.) In the flow of social life, then; persons 
constantly choose among appropriate alternative ways of realizing their 
social intents, faking those choices in ways that will from their point of 
view (based upon their sociocultural understandings) communicate the 
subtleties of their social perceptions and intentions at the moment is part 



of. the efeaiive;. activity iri which participant^ 

routinely engage; * ^ - •• 4 - ; 

To summarize the theory of social j'nteraction presented, here: t 
^"'participants-^ events, in an : $d_ hoc " 



way. Drawing upon socfocul tural rules* maps, and plans, <{iey perpetually ; i; 
interpret the event as riew perceptual data are generated through others 
actions. And the^ abi perpetually orv the ba'sis of their interpretations^ ,' ; 
selecting among the options for behaving that their interpretations of the 
situation and of the relevant situational rules suggest are appropriate at 
the moment, given their social intents. In short, they are contributing to 
the event that they. are. interpreting and doing so on the basis of their 
interpretations of it. They are mutually informing one 'another, , through 
their on-going behavior, of the definition and purposes of -the event they 
are treating. All participants in a scene are simultaneously engaged in 
this "cybernetic" interactional work;g|nd collectively, through this work,- 
they, are accomplishing asocial event; m *\ ; ' - \ 



Some Implications For The Design And Conduct Of Evaluation Inquiry, V 

My claim in introducing the theory just .presented was that it . 
provided a J ink betwee^the phenomenologioca perspective and the field yt 
method of anthropological ethnography --a link that is missing in \ M : 
'descriptions of naturalistic/qualitative apporaches to evaluation.. I - 
suggested that such a theory would help to assure the descriptive validity 
of evaluation field studies:, that it would provide a .set of principles for 



deterrni ri i rig where to lobfc, what to iodic .for, arid how tb structure looking 
: ;in 'order- lo'-'Tsten-tify. and. gain data^lK those locally situated systems, of 
meaning* belief , value, and action that are constitutive of and/or 
.funciYQr^ innovation^ to be v 

evaluated. Npw, it^s appropriate to explain some of th^se methodol ogi cai 
principles. - AV.l; do so Below /I assume that the general goal of field ■ 
; study in evaluation, is a descriptive-analytic one, i.e., to understand, 
describe, ajid explicate the program to be evaluated in terms of. 

parti pi pants 1 social^ real i ties. From the perspective of the constitutive 

• r i> . . ' -\ ' ; ■ ; . ■ . ;,; -. ; 

, ethnographic theory* of soci al ' organization , thi,s 'goal can be restated as 

ii **• * . • • .,• • • • •* . . - . — . •• . . - ....■■/.••■■ 

•follows: to~ describe how the program in question is socially organized, - . 
specifying the cultural , m^chi nery that generates that organization (c.f.> 



Mehan, 1982:59 r 60^ ; " v m ] ' 



S 



• A First P'rincipje: " Fmphasis on ^ Observation 
: . ' : Ethnographic eVal liati ori inqtii ry designed in lijjht of the constitutive 
, * theory set but ,.abpye-^pul d ;alJocate resources such that ethnographic 
' observation toot precedence \over"rnter^ This, is a departure frppi ; 

1 : what advocates oft, naturaji stic'/quSl itative •eval uation generalty recommend y 

: : ^.,- : r : :.'V. : : v ; .;/; 5; . , ' _ . . : _ .;' . V J ■ "sf / 'V : : *y. - . 

V ' ? m thatr: ( 1 ) > the^l^ter pi ace equal' emphisjsw and observing, t 

suggesting* that %^^iewing is espedial.iy .imjiortant for getting at program 
■ participant^ from their ' 

tendency ,to treat r^S^itfes Vand meariirrg- as subjective states that Tie only 

. ■ " ' . v. '• J ' _ • 

; in the mi rids of participants); arid (2)- ethnographic observation entails a 




kind, of hbtK seems /absent in tHev*?.x ; ': ; • %'. - V 

natural istic/qual ftattv^ bet as see 

how the theory abo^ departures^ 

- The constitutive theory of social organi zati on -po^i^. that as persons , 
procged through" thefr daily social lives, they interpret the. context from .-^ 
- mbifierit: to itio^ sense of "wl^ we: am j 

are doing now. H And as they do they routinely select their current and " > 
: ^:-next. actions 'in light of the context as 'they have interpreted it, within 

' • . ' f •• ; » • . ..• v. . •• -v -' » : " •••••••• 

the parameters of their so ciocirl tural standards of app^ . Thi s .., ; 

process goes on daring interviews as it does during other soci a! ;. 
occasions. Interview respondents make sense of the si tuation: th^y draw : 
'- upon their sociodul tural , knowl edge to arrive at. interpretations of such _ 
matters as the social identity of the interviewer (what "kind of a person" / 
she/he is), his/her "purposes for coming here, ^why he/she wants to interview 
-1 me; what' social Vights and obligations the interviewer and I have with 
regard to one another in general and in this situation, and so on. 'As the 
v interview, i tsel f * unf ol ds, these and si nil 1 ar matters " are the subject, of 
v continual interactional negotiation between researcher and respondent as 
they "read" one another's fact-to-face behavior iCicourel, 1974; Erickson ' 
and Shultz,- 1982). •- , . ' . • ■ ' . . ' 

Furthermore, the respondent is in the position of having to make/' 
sense of what ^ exactly i : the t nte rvi ewer wants to know. . -There are a great ' . ; 
many wetys of aS^-^hing^ ng- about the aspects pf one 1 s personal - 

; knowledge and fc^periehce that, appear to be indicated by^ simplest - 
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and most straig/ltfdhvard question. And (the constitutive theory tells us) 
language, along with other symbolic forms, is indexieal. The interviewer 
,. cannot possibly say all that she/he means in so many words; she/he must 
count on the respondent's ability as a culture membe^ to fill in meanings 
sensibly around what he/she. says. Thus, at any given moment the respondent 
must interpret how to carve up (or arrange) and present his/her knowledge 
and experience; and he/she must do so based upon his/her general 
interpretive understandings of who the researcher is as a kind of social 

. : . . ■ _ . ______ . . 

person, what the researcher's project is about, why he/she has been chosen 
" as a respondents where the interview has been and where it appears to be 
headed, as well as in view of the wording of the particular query the 
intervi-ewer has just posed. . . ' , / 

x In short, the interview places the respondent in a social context 
' outside the flow of his everyday life and presents him or her with the task 

of producing, in this situation , talk about some aspect(s) of the program 
, or other feature(s) of his/her daily affairs. What the interviewer 

receives, then, is not "facts" or even the respondent's perceptions of the 
facts.- What the interviewer receives is a conjointly produced and situated' 
account of some actions, thinking, or emotion^ It is a conjointly 
produced account in that it is generated by the successive interactional 
moves of both respondent and interviewer. And it is a situated, or 
context-specific, account in that it is produced "here and now" vi thin the 
successive frames Of --the respondents ' moment-to-moment interpretations of 
what is going on and what that implies' for his/her action 
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choices. Whether 
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" the beliefs and values and feelings, the perceptions and interpretations, 
described in this <nt.»gt.inn are in any way functionally relevant to the 

program is problematic. Whether they are depends upon whether the 

• •/'___" T 

interviewee holds, experiences, and uses them in taking action in one or J 

another of a variety of naturally occuring, everyday contexts. And all of 

this remains true regardless of how carefully worded and sequenced the 

interview questions are, how' much affective "rapport" is established, and 

how "truthful" the respondent strives to be. As anthropologist Charles 0. 

Frake (1980a: 50) has succinctly put it: / 

'"' The problem with [respondents'] verbalized interpreta- \ 
tions is not a-difficulty in eliciting them but in lo- 
cating what cues are being responded to [by the re- 
spondent] in formulating a particular interpretation. - 

This does not mean that an ethnographic evaluator operating from a 

constitutive theory of social organization would reject interviewing or 

would relegate interview accounts to the status of ^mere talk." . (I will 

discuss the role that interviewing can appropriately play a bit further 

on.) Rather, as Frake points out it mean that: . ' 

Perhaps instead of trying to devise provocative questions 
and other instruments to persuade people to talk ab&ut 

things they do not ordinarily talk about in that way, we _ 4 

should take as 'a serious topic of investigation what people 

in fact talk about, or, better, what they are in fact doing 

when they talk. When we look at talk, we find that people , 

do not so much ask and answer inquires; they propose, • . 

defend, and negotiate interpretations of what is happening. 

Because what is happening is what we are interested in . 

explicating, these interpretations provide the key to 

* underderstanding. Viewing informants not just as question- 
"~S - answers, but also as interpreters of their lives, provides • - 
not only a sounder perspective for handling problems of , ; 
■ informant variability and reticence, but, also a more 

realistic notion of the relation of cognitive systems to 

behavior (1980a: 50). - = 
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. • • ■ • • : . • . V. ... . , ... 

•The constitutive ethnographic evaluator, then, would place heavy . ■ .. 
emphasis on observation and, in observing and documenting, upon the talk 
that program participants do in* natural ly occuring* circumstances. He/she 
would do' so not because seing what is going on is more important than 
people's ideas and beliefs, values and interpretations. He/she would, do so 
because the ideas, beliefs, values, and interpretations that people are 
using to generate what is- going on, as well as thei r moment-to-moment sense 
of What is goi ng on, are displayed in their everyday talk and actions, 
this foil ows from' the premise that culture is intersubjective in nature. 
As Eri#son (1978:6) has explained: ';; 



The assumption is that people engaged in face-to-face 
>: interaction are'constantly engaged i n -tel 1 i ng. each other . ± 
verbally and nonverbal ly what is going on, what the rules, . 
are and what the context is — and that careful analysis : 
of their "telling" can elucidate their underlying purposes 
and rules of procedure. Statements of such regularities, 
then, would not be just an arbitrary construction of the 
" researcher, but would actually make, contact wi th the poi nts 
of view of those involved in the^ction. 



I • « 



Observing with this assumption in mind, is what I intended by the term 
ethnographic observation that I used in introducing this section. 
\Qrv,ing ethnographical ly means keeping a weather eye (and ear) out for 
whVljCpedple are "telling" one another as they interact about their 
sociocultural systems of standards for perceiving, believing, evaluating, 
and acting; about their notions, of kinds of people things, and-, social 
contexts; and about the situation-specific social meanings of actions. 
'This kind of observing, it seems to me, entails a very different kind of 
noticing or attending than one would otherwise do, as well ,as to a ' 
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different way of thinking about what one has observed. The n attire of these 
differences is difficult to formulate succinctl^; but the fact thgt they v 



"i 



constitutive ethnographic evaluation. 



A Second Principle:/ inte^viewst to Gialde and Explicates Observation , 

For the reasons set fofc above, interviewing in an evaluation oriented 
by the constitutive ethnographic" theory of socill organization would play 
an supplemental role.. Host importantly, it would help to guide and 




explicate observation. 

* Interviews as a guide to -observation. Interviews can guide the 
ethnographic etfaluatbr's observations in two ways: (1) they can suggest 
where and .when to observe; and (2) they can suggest issues and dynamics to 
attend to in observing. 

Especially duri ng the early stages of liiquiry^ interviewing can. help 
the evaluator to locate the scenes in which^from participants' point of 

x How to do the sort of ethnographic observing mentioned here is.' beyond 
the scope of this paper. The interested reader, however, will find some 
useful guidelines in the work of Erickson and Shultz (1977, 1982), Mehan 
-(1979), Philips (1983), and Scheflen (1973, 1974), as well as in- v 



studies are based owl audiovisual documentation* of interaction, but it is 
possible as research by Frake (1980b, 1980c) has shown, to learn to see 
with the naked eye and to document in t fiel d notes what participants are 
telling each other situational ly about applicable cultural principles; The 
research assisted by audiovisual documents, however, provides the best 
foundation for the neophyte who wishes to learn, from a constitutive 
ethnographic perspective, what to 1 tiok for and how to think about what one 
sees. ■ * - v. • - ' -l • ■' . ... " • '\ • • * ' 
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exist is indicatean^ the tact that trake, as recently as ly//, telt 7 
impelled to urge ethnographers to observe in this way. -Arid to reiterate: 
this kind of ethnographic observation woul d be tfie fundamental, method of a 
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view; the program is routinely, enacted; they can also ne^p indicate which 
of tft&se scenes participants construe as most central to their pro grtam ~ 
efforts. Simflarl-y, when interview respondents descriT^connecWohs , . ~ 
between program elements and other phenomena in their world, their remarks 
can- direct observation to settings, scenes, and activities that might * 
otherwise be deemed, irrelevant to ^he program and fits evaluations* 

: ■ ' . * — ■ ' - ~<~ 

topics, theftes, and issues worth attending to in observing can emerge 
from interviews both directly arid indirectly. If, for example, interview, 
respondents stated routinely -.and explicitly that an individual Vs "style, "of ~~ 
leadership" had significant bearing on the program arid its effect^, the f 
ethnographic evaluatbr would probably want to pay special attention to that 
individual's patterns of interaction with other paj^fef^i pants across- a 



x Interview information, of course, is not the only guide an ethnographic 
e valuator wbul d use in deciding where 'and when to observer What program 
participants say arid do in naturally occuring circumstances can serve as 
another, arid sometimes better, source of direction. As an example, • 
school -si, te participants in one California program routinely informed, 
evaluators that site council planning meetings were, the main scenes of 
program activities. But observation of these meetings revealed that key 
planning decisions were-, routinely made prior to the meetings themsel ve^ vin^ 3 
casual conversations among committee members. This suggested the need to 
"track" committee leaders through their daily rounds in order to identify 
how critical program decisions were actually reached. ' 
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variety of rgcurrent 'cbn texts, and to exanTiS.e the functional ti\nks between 
those patterns and subsequent; events^ Qr agai^r^ti^pdse that sub-sets of 
: parti ci pantsT^fei^^rst 1 ^ views of* which events were 

most essential to ^he program's en 

responses could imply that different groups within the settyig- he! d , > 
distinctly' different interpretations of the program, differnt defintions of 

V what the program is "all :abput* , V Observing with this possibility in mind* 
the evaluator could consider Whether participants words and actions/ * 
manifested these, different perspectives and, if so,' how their presence . 
influenced the. program's performance. Patterns, in respondents 1 accounts of 
the program's history,; its 1 influences on organisational procedures, its 
benefits and costs fp^partiei pants arid clients, and a range of similar 
issues can also indicate issues the evaluator should think about in 
observing and making sense of what is observed. \ »■ 

. that interviewing can help indicate where and when to observe, as 
well as what to attend to' in observing; is. hardly a unique idea. . 'The point 
here, however, is that from a constitutive-ethnographic perspective 
interview information can only serve as a guide —it cannat'be treated as 
study data— unless and until it is tied to phenomena which are observed in 

;'• naturally occuri.ng events and related functionally to the prograrm This ',. 
follows from the* ethnographer's interest jn. the functional relationships 
among aspects of participants' culture(s) and program activities and from 
the view of interview remarks as situated accounts. 
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rntervfews to explicate what is observed, Thi s second major rol e 
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interview eyaluatiori is by far 

the more important; The constitutive ethnographer;; 'as noted earlier, takes 
the position th;at group members display their sociocultUral standards (or 

:* social N real i'ti es ) ;*rn 1 nteraetmn : they continually inform one another in 
. their verbal and. nonverbaT .behavior about 'trheir situation-specific social 
purposes and about "what is going on y now., wh^t /the 'rules' are, and' what 

> the context is" (£ricksdn, 1973:6}/. Nevertheless, everything that is going, 
on from participaiits'. perspectives cannot be^taken as unequivocally 
apparent' in their interaction. In any case, ^^constitutive ethnographer, 
wants to check has behavior-based analyses with thpse doing the acting in 

: order to approximate* an emi c. desc ri pti pn of the action observed. Thus/ the 
greatest part of the co n s t i tu ti ve -e th n dgr aph i c eval ua to r ' s interviewing 
would be undertaken to elicit pd < rticiparits ! descriptions and explanations 
of the program-relevant interactions l ; n which, they routinely engaged. f A 
usual strategy for obtaining .such Tpformatipn is to ask peojfle to ta1kA> 
about what they are doing as they are : doing it or as' soori as possible ; 
thereafter. Often, too, con s ti t u ti y e ; ' £th n o graph e rs use an audiovisual record. ; 
of an event to help participants^^ ihte^ews what they were 

doing and thinking during the ^ 

1982^ Erickson and Shultz, 1982 )^-- r the ethnographer assumes that bringing 

the interview to the natural lyj'occuring interactional rsbene (or^in the 

■_ __. ._ J ••• "■ ■'■ v • •.■ 

latter case, bringing tfi^irSt^raetiorral * seen e to th§ interview) helps . / 

-'-■■^ ,., v.-; -.- v';.^' : .• * ; - 
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provide access to the beliefs* value's, and ideas; the : context ^specif i : c/ 'V;'^ 

rules for interpretation and action, etc* that participants, were actually 

Using to construct the observed event. The goal is not only to capture . 

participants 1 interpretations and intents while they 'are still fresh in 

participants 1 mihds. Mo re ijnpo rtanti y , it is to help the respondent ; 

sustain the haturaflly occuring context as the salient interpretive; frame: 

to facilitate the respondent's ability, to report on action and/ thought /in 

terms of '.the everyday interactional scene^ rather than in terms oftjie 

interview content* * * u * r 



rd Principle: Use of Ethnographic Rules of Evidence 



Most works on natural istic/qualitative evaluation enjoin 
invresti gators to. search "Tnductively for "patterns, themes, and categories" 
in their data {Patton, 1980:306). In the naturalistic or qualitative 
paradigm, these "recurring regularities in ^sources" (Cuba and Lincoln, . 
1981:93) indicate directions ,for on-going inquiry and, in final analysis of 
the data, constitute findings, the nature of the patterns that evaluators 
should seek, however, is described rather incompletely in most recent 
writing on naturalistic/qualitative evaluation. Usually, examples of 
patterns and categories from actual evaluation data are*- given, and the •■ 
investigator is advised to look for ideas, actions, words and phrases that 
recur and seem logically to dovetail.' 

Anthropological: ethnographers also seek patterns in this way as they 
conduct inquiry and. review their" data. But ethnographers, particularly 
coiistit^iie ethnographers, can usually be more specific about the kinds of 
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patterns that count as eviciehce; Fundamentally; they seek patterns df 
co-occurrence among- phenomena —patterns which display the system(s) of ■ 
standards for perceiving, believing, evaluating and acting which group 
.members are using in sita* to organize their aff^rs. 

When phenomena routinely occur together at. a particular moment in, : 
time 'and function conjointly,' they are described as in vertical 
co-occu^ren'ce. • When they recur consistently together in sequence and 
function in relation to one another, they are said to be horizontal 
co-occurrence. Patterns -of vertical and horizontal co-occurrence display 
the cultural knowledge-and practices through which participants organize 
their lives at a variety of hierarchical levels. Some display the very 
small or-brTef contexts that participants recognize, the social meanings 
particular behaviors have in those contexts, and the rules for selecting 
and interpreting actions appropriately that are applicable in them. F6r 
instance, in a study of face r td-:face communication in dyadic counseling 
interview^ Erickson (1979) found "that among White persons a speaker's 
simultaneous production of, a clause terminal juncture, moderately falling 
intonation, and a glance toward the listener routinely meant "I want to 
kno.w if you are attending to and following what I am saying." In other 
words, the vertical co-occurrence of these behaviors meant that the 
listener was expected to give some listening response "now." This emic 
social meaning was evident in the routine (horizontal or sequenlff^l ) 
co-occurrence of such a response in the form of a vocalized "mmhmrn 11 or 
"yea 11 *" a head nod, etc.. That such forms, of behavior as these in fact • 

.' ; . A t .'■ / ' ' : . . . ./ , ; ■ ... ... ' . ' ' 



functioned as listening responses (i.e., meant socially "I'm following what 
you're- sayYng' 1 ) was revealed in what the speakers regularly did next 
(another pattern of horizontal eo-occurrence) . Recognizing a listening 
response in the behavior of the listener, speaker's routinely went on to the 
next speaking point. Failing to receive such a response, 
speakers consistently persisted at their point, reiterating the same idea 
in progressively simplified and concrete ways until the listener -enacted 
.some form of listening behavior.* 

the latter example deals with some very fine-grained bits of social 
organization that are evident in patterns of behavioral co-occurrence: 'the 
situated social meanings of certain behavior forms, thS generation of some 
'very brief contexts (kinds of moments in conversation), and some rules for 
interpret!" ng~ others ' behavior appropriately and selecting appropriate 
actions oneself. : Small patternings such as these,. the constitutive: theory 
suggests, are interwoven such that they constitute '^larger" or more | % 
encompassing social organizational units. Broader, more enduring contexts, 
for example, a re., generated., and sustained through (and recognizable to the- 
observor in) the patterns of posture^arid orientation that interactional- 
participants take and hold, as v^eil as in the organization of talk that- 
co-occur. with these "posi 1 1 o ni ngs . " ( Do r r-Bremme , 1982; Erickson and 

A This can seem an' obvious or trivial finding until' one considers that .. 
Black an\j White participants in Erickson' s study employed entirely 
different sets of rules for signal i ng 1 i stem" ng-response-rel evant moments 
and for indicating listening. As a consequence, White speakers most often 
ended up explaining points over and over again to Blacks who were in fact 
listening and understanding, and Blacks in turn felt that Whites were 
"talking down'" to them in demeaning. ways. • ',, 



Shultz; 1981; tlcDermott, 1976; Scheflen, 19730 Shifts in these patterns 
regularly co-occur with one another and with participants 1 pdilThoc 
interpretations of "when the context changed." , Even more encompassing 
co-occurrence patterns display hierarchically higher levels of social . 
organization. An ethnographic inquiry by Mehan {1983}, for instance, 
identified the patterning of the special-education referral . ,J 
process in a school district. (See Figure 1,' nekt page.^ Notice" that- the 
pattern -of activity depicted in the figure in fact embodies a* numbfer of , \ 
more specific ones, e.g., the patterns which routinely constitute the 
processes of referral assessment, consideration of placement, and so on. 
(These are only suggested in this diagram; Mehan has described them 

elsewhere.) In identifying and explicating how these patterns are 

. * ■ .j ] * _ __ 

generated, Mehan' has provided ah account of the ?. b. 94-142 decision making 

process across several "nested", levels of social organization within the 
school district he studied. 
„• Co-occurrence rel ati onstiips ,. as noted, appear in routine behavioral 

patterning^, but they are also sometimes indicate^ when interactional 
participants: (a) call for ; or offer an account of some behavior or set of 
behaviors, or (b) positively or negatively, sanction certain behaviors. , 

When, participants account for or make accountable the absence of some 
behavior or combination of behaviors, the observor can infer that there is 
a "rule" for its occurrence in the place where it is missed (Mehan and 
Wood, 1975:132-135; Schegl off, 1972). This principal is apparent in ■■.-■■./. 
everyday remarks such as, "I called you; why didn't you answer? Are you. mad 
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°at me? H Similarly, one. program participant asking another something like 
"Why didn't you assess tils psychomotor skills?" can call attention to the 
rules of normal prQcedure in /'cases, such as this one v" The evidentiary 
principle based on accountable absences is merely a corollary of the 
co-occurrence principle.. In unfamilar settings, however, it can often 
kj^ve .useful in calli.ng attention to previously unnoticed rul es . 

The same ts true for participants' positive and ji£ga£ive sanctions. 
Participants who enact these are telling others in the scene (and the 

evaluator as well)' what the rules of appropriate' procedure are here and 

- y *' . - ■: V;,; • ■;< _ _ ■ 

now. tias^Kpom scenes are replete with instances of positive 'and negative 

sanctions, many of v which include explicit formulations of appropriate 

rules: e.g. , "Lboic^up tfere^ please.^Id^^he time to be'listening to me, 



\ 



not ^talking to your neighbor." Instance*<^ abl e in 

•routi ne .program i n teracti ons : "This is the kind Pf report that tft^ > - 
superintendent wants to see!";< "They sent back our application; we didn't 
fill in the budget in forma ti on Vcor^ectly . " , /Hot i ce that f^pl:rth i s point of 
view what at first appear to be "unsanctioned violations" .of the rules can 
serve to indicate the rules that are actually in use. State- law .or 
administrative mandates may "require" certain budget ^ information,* but if 
the absence of ' that ; infdfm^ withbut notice or negative sanction,, 

that repirementiis not-a functipnihg part of thl^pr 

• Together with .the principle of co-occurrence and the principle of 
^accountable* absen.ee, this principle of posit^e and negative sanctions -.- 
"Vtafids as an e vi dent.i a ry . pr 1 n ci pie tts;ed in constitutive-ethnographic 
, iKifLiiry. 7 • v" ; . ' — .. .-• 



\ 

• * \ 

v. in summary ^patterns of co-occurrence are the main evidentiary base 
of constitutive ethnographic accounts. These patterns are recom\zable in 
the behaviors which' routinely "go together'^ at particular kinds of moments 
in time and those that routinely follow one another in sequence through 
time and which are functionally relevant to o ne another and (thus) to 'the_ 
social event in question and. the program as a whole. Once again, the 
functional relevance proviso is a' key one, It differentiates the , 
ethnographer's concept olf co-occurrence from the statistician's concept of 
correlation. The functional; relevance of * a specific; behavior or set of 
behaviors. is apparent interactional^; what happens next when the 
behavior is present is systematically different than what happens next when 
the action is absent.* From this perspective, "deviant" or "disc repent" 
cases -cases that do not fit the pattern apparent In most ; compa rab 1 e 
instances- are not treated as "unexplaoned variance" as they are when 



correlational methods arej employed. Rather, as Mehan (1979:105) points 



^_ 




r When -action takes place that seems to violate the rules, 
..but participants do hot mark the violations, it means the 
data has not been described adequately. 

Apparently w discrepent cases, then, are taken as a cause for further 

inquiry and/or analysis., f , t -f 
4ft Fourth Principle: Treatment of the Program's Definition and' Boundaries 
as Problematic ^ j "*. ; : ^ 

Oriented by the constitutive theory of social relations, an 
ethnographer, embarking pn evaluati^i ^inquiry ,^uTd,treat,the 'definition and 

*~As an example, consi der Erickson ' s - C1979); f i ndi ng regarding what ; . : j 
^llkersli n^Ii In the .presence or absence of a listening response. 



■ *.v 



which motivate 
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, boundaries of the program to" be studied as problematic. He or she would 
' raak e participants' interpretations of "the program" a central matter during 
inquiry. 

There are several" elements of the constitutive theory 
thi s pri nci pi e of in qui ry desi gn . Fi rst and most basical ly, the 
constitutive theory assumes that participants in social endeavors'take 
action 'in light of their interpretations of "who we are and pat we are 
doing now" at several hierarchical levels, e.g., at this moment in this 
situation in this event during this phase of this program. It follows that' 
as participants go about addressing the program, their interpretations of 
the program's rationale, goals, emphases, requirements and. optional fea- 
tures, etc., will influence their sense of what is going. Wi and of what 
role they are 'expected to assume. at the moment. These interpretations, 
then , " wi 1 T i nf 1 Uence parti ci pants " action choi ces and so the program's 
' overall enactment. Thus, from a constitutive ethnographic perspective, 
participants' interpretations of the rprogram are likely to .be, a main factor 
in how the program i s actual ly shaped at particul ar si tes . • 
' ; Second, that participants must interpret the program is taken as . 

given from the viewpoint of the constitutive theory. , It is true that .? 
Nearly every program is defined and explained in a variety of documents: 
'* enabling legislation, administrative guidelines, "how-to" booklets, 
curriculum objectives and materials, and/or others. In .addition, % ^. 
participants at local sites can usually gain furtherllnTo^ati^pn on 
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particular programs in face-to-face briefings with experts of various 
kinds, But as is the ease with all symbolic forms, , the- language ;of these'.- 
sources is indexical , inherently inebmplete.* None of them is, :nor"are 
all collectively, a complete script for assembling arid maintaining the . 
program from moment to moment. Those who are to enact the program i as. part 
of their daily lives, therefore, must draw upon their cultural knowledge 
and personal experience in .order to determine, first, which available 
documents and which briefings merit greatest attention and, next, exactly 
what the words they contain mean for action "here and now."* ; 

: The constitutive ethnographer, then, would treat definitions of the 
program inherent in documents, ^briefings by program experts, and in the 
interview accounts of participants, as situated, indexical, and open to . 
interpretation as part of the normal, natural course of social affairs. He 
or she would approach these. accounts as data. In so doing, his or her 
' primary interest would not be W whether participants' at a particular site 
had arrived at a "correct" understanding of the program. Instead, the, ".^ 
constitutive^ethnographer would be concerned with how the interpretation^ ) 

, . ■ ■ ■ .' . ■'. \ , ..••-'* ■ * ■» _ a ' 

* The concept of indexical ity is defined and explained on pages 26-27 
above. . . %4 '■ : - .. :■■ 

** nnrr Bremme et al 1979, offer a detail ed description *of how the - 
docSme^s aTbrlefing ' provided in definition and support of one program, 

• offend very different definitions* of that program at various mounts in 
?l2 f I q in the same ye«J as wel 1 as through time ;( from one year -to, _ 
anotheri!"Tiis %*ft£ a! so -analyses some systematically. different ways m 
I?ch the same program was interpreted and enacted at various schools , 

: sites. ii>:\,_ ■ : ■• 
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apparent at' this site had been achieved .and how. they functioned }h the , 
program's enactment. Furthermore* he or she would seek local ;, ' ; v 
interpretations of the p^n^m in situated interaction, tuning to , 
interviews only as a way of' obtaining elaboration on what was observed. 
Arid recognizing the reciprocal 3 , "reflexive" nature of participants' ^ 
interpretations aiffi actions the constitutive ethnographer would consider 
participants' interpretations- of the program and their enactments of i,t as 
likely to be dynamic, rather than static. Thus, he/she would keep an eye . 
out for evolution in participants' conceptualization and performance of the 
program over time. . - ' 

\ Fifth Principle: Inquiry Centered on Interactional Events . 

This is, a principle of specific inquiry tactics. It entails 
guidelines for sequencing)^ focusing inquiry during the course of an 

evaluation. > • ^/ 

* From the perspective of the constitutive theory, social life , is 
organized at various hierarchical levels. The -single communicative moves 
of individuals are juxtaposed in a variety of ordered ways in interactional 
exchanges, (e.g., questions a^nd answers, conversational "points^ and 
listening responses). AExchanges>e strung together in sequences that 
' comprise social situations within events or occasions (e.g., the • 
•.; ; elicitation-response-evaluation sequences that comprise teaching 
interactions-, Dorr-Bremme, 1982; Mehan, 1979). Sets of sequences, ~ 
\ organized in certain ways, constitute -recognizable kindsof social events 
' -legislative sessions, phone calls, meetings, classroom lessens, other 
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"service-delivery" -transactions. ultimately, sets of events enacted 
simul taneous'ly in various 1 ocations ind sequenced in Various ways 
constitute what conies to v be gl ossed as' "the program" . i tsel f . And to 
reiterate a key point: as persons carry out these interactions and sets of 
interactions and so '^construct", .or/'accompl ish" the prog ram /in question, / 
they are- drawing constantly upon their socioculturaT knowledge. Their 
actions are based in their systems of standards for, perceiving, believing, 
evaluating, arid acting; their "maps", of kind of people, actions, contexts, 
•and things; their notions of the relationship? that obtain among the 

latter, and so on. . > . , • 

THul, as the ethnographer undertakes^nquiry/in the service of 
evaluation, he/she' is faced with two fundamental questions: (i) What level 
of social organization should I concentrate upon ip conducting my 
.observation and interview! And (2) Aside from- participants 1 
interpretations of the program itself, what elements of paticipants' _ ' ■ 
culture(s) (or social .realities.) should figure in my inquiry? 

Constitutive 'ethnographers usually resolve both these questions by 
centering inquiry upon whole events then proceedi ng "up" and/or "down" to 
hierarchically higher and lower levels of social^ organization (and the 
aspects of culture they entail ) in order to examine and explicate elements 
of culture that influence how the events taken as central are . 
accomplished. • ."" „,.'.. 
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v this tactic, has two distil First, "events" are'salierit 

for participants and readily locatable in their Verms. Members of social 
groups usually have names for units of sacial life at this level of social 
organization: legislative briefing, parent advisory council meeting, staff 
development, session, program review debriefing, etc They can easily 
<Hirect the inquirer to events of this sort, and they can offer general 
accounts of what they are "about." The boundaries of larger arid smaller ' 
"chUHki" of social, life are often. difficult for participants to identify 
arid agree upon, and emic labels and .descriptors for them are .usual ly less 

- ■ ■ » ' ' * ■ i * -.■ ■ 

• _ > ■ ; ' ■ • t 

precise than the investigator would like. Second, and more importantly, 
"concentrating, on events; serves to focus^' inquiry .at an "intermedial:!" level 
of social organization.. As the investigator observes these events and 
interviews participants about them ih the -ways, described above, she/he 
obtains information o'n which other aspects of culture and Revels o& social 
-ordering seem functionally relevant to the events enactment, 
then study thesfc^nd explicate the relations of function. 

: An example 'will .help clarify this process. Invths evaluation of *the 
California school program mentioned briefly above, observation focusecT upon 
site council planning meetings and upon info rSai decision-making encounters 
that routinely occured between these formal meetings. Parents were 
allocated seats on the site council at eacli school by law, and ev ery one v 
concerned with the program interpreted ^parent i nvbl vement" as- a main 
1 program -goal . Nevertheless, jla rents; Were rarely present during the. 
informal encounters in which program decisions were substantially made, arid 
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they played only a minor role in site eburiei Vdi scussioris. All this 
suggiited the need to explore the general social organization ; ofv 
/parent-school relationships, iV^e;^ at a broader hierarchical level* • 
It also suggested the need, to examine the social organization of discetrfse 
at a more fine-grained level within the meetings, in order to understand ... 
how the role of parents and others in the event were situational ly . 
produced* Findings from the former line of inquiry, illuminated -j^w parents 
and staff members beliefs about societal roles became enacted in some broad 
.institutional arrangements --arrangements that inadvertantly but 
systematically deterred parent involvement in the program. .The latter line 
of sociol inguistic inquiry surfaced ways in which staff members 1 lextcons 
a§nd interactional str^tegigs during the formal meetings functioned (again 
inadvertantly) to' discourage kr\d subordinate the participation *of those. ,. 
parents who did turn out for program meetings. Each set of findings "had 
clear implications for program management and the delivery of program 
support services by the state education agency.' ; L i: : ; /; 1 

. In summary, the general tacti q -i n an eyal iiSti on field study following 
the constitutive theory would be to 'center *i nquiry on events and then to 
move outward from events as the data 'seem to dictate: either "up" to V'.- 
layers of culture and social organization in which* the central events are 
embedded and/or "tidwn" to level s of ordering within the event(s), tracing 
relationships of function across various:;! eve^ss* ; , 
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. Summary And Conclusions ''.'.«•" 

.'#.' .;' As is the- case with naturalistic or qualitative approaches to 

'.,"/''' ■ ' v* / -'3>- r . & ■■ ■ ' . * ■ 

inquiry, anthropological ethnography has its roots in phenomenology, in 
addition, it shares with the generic naturalistic/qualitative paradigm an 
inquiry method which is holistic, inductive, and interactive —brie which 
i ncl tides both di vergen t and convergent phases in' an on-going cycle of data 

. ' . "! v J • ■••'■*■' " 

_ ■ -1 J " 1 • * ' ' _ ■■ v 

collection and data analysis as the investigator him- or herself ^serves as 



the primary r ih^ the generic naturalistic 

or qualitative approach (as elaborated i^ 

anthropological ethnography entails theory which el aborates the basic 
phenbmenplogical premise that persons act on the basis of the meaning that 
actions and things have for them. I have described one such theory here : 
and described how this theory, provides a link between the phenomenologicaX 
perspective and the f iel d method . of constitutive ethnographic inquiry. In 
s^p^doing, I have suggested five broad methodological principles .'which an 
natural i s tjc/qualitative eval uation which was al so a constitutive ^ V . 
ethnographic evaluation wou^ld employ.; Further, I have tried - r ^^?mafc^^ : - ^ 
explicit the connections between these principles arid; ^ the cqn^tative : 



theory. My contention has been that an evaluation following ^ principles ^ 7 
such as these. would have, greater descriptive validity: it would be better 
able to provide/ a description and explication of the ; program in .question in' 
terms of prtici pants' cultures or social realities. ; . 

, • Despite its length, the discussion presented here i s only * 
illustrative. Other theories of social torgahizat.ion founded in other 
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perspectives bri culture and language use could be elaborated; ^hese Would 
have slightly different implications for the conduct of evaluation field 
inquiry. Other methodological principles coul d be- drawn even from the : 
^constitutive,^ of this paper, then, has 

-been (1) to suggest that some theory of social organization is inherent in 
%ny natural i stic/qual itative description and /analysis; and, (2) to point . 
out^ ho v? a mor e adequ ate theory , based i n empi ri cal wo rk, c an help to bring 
riatualistic/qual itative description and- analysis closer to the social^ 
realities and notions of meaning.whicjn participants actually use' in 
assembling the- program under study. ■*■■■■/"■ 

> In. concluding^ ^urri to the issue implied in the title of the paper: 
the goodness of fit between anthropological ethhpgraphy and evaluation. : 
What role, if any, can ethnography of the type I have outlined' above pi ay.^ 
in evaluation practice? To a certain extent, this question can be answered 
by saying that an ethnography "can serve all the purposes in- Valuation tha£ 
are routinely claimed for naturalistic/qualitative a^orache^ in general i 
It is generally pointed out, ^*f or exampl e, that natural i stic/qual i tati ve 
V inquiry is more compatible with such evaluation models as the goal rfree 
model of Strive^ (1972), the responsive, evaluation model advocated by Stake 

(1975), and the illuminative model of Pari ett and Hamilton (1976). For the 

• p - ' <\ >•.'■ ' . ■ ' * 

same reasons (see. Patton, 1980, and Guba, 1978 for their explication), 
ethnographic* inquiry is also more consonant with these models. Like : 
natural i stic/qual itative approaches, too; ethnographic inquiry can be 
especially useful when the evaluation is centered on program 
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activities and processes and/or oriented to the multiple values and 
information needs of various audiences. Similarly,' an ethnographic method 
is appropriate when the purpose of evaluation is to refine and improve the 
enactment of a program, to increase the effectiveness of its management, 
and/or -to examine its implementation or adaptation in particular 
localities. : r ' : ,••*<•.... : - * 

.* . The advantages of ethnography for the purposes are those of v j - . _ > 
naturalistic or qual itative i nqui ry in general . These i ncl ude richly y . ,- 

detailed description and holistic explanation of program processes and f ; v 
outcomes which are portrayed as they occur amidst real World complexities. . 
They al so include the ability of the field study method to surface program 
effects and influences that are missed in evaluations oriented by ■•.;/ 

■ psychometric premises and experimental or quasi -experimental designs ., 
(Dorr-Bremme, in press). But, following principles such as those set out 
above, an ethnographic inquiry can exceed a generic qualitative- 
naturalistic one' in portraying program processes and effects more fully in 

terms of participants' ways of understanding- and experiencing reality. . ' - 

This as noted earlier, can enable' program managers and'sponsors to act on t 

■ . , . •■ ".'•< . •' • ■ ■ ... .... ■ ■ '. ' : " i ""* r ' . ; ". ' 

the evaluation in ways that closely take into account and respond, to the . 

needs, concerns, and viewpoints of participants in local settings. 

On the other hand, following an ethnographic approach to inquiry can 
i exacerbate the disadvantages of natural istic/qual itative methods f ; ' • 

•generally. , Its emphasis upon observation and its de-emphasis upon ' 
: widespread interviewing, f<y instance , makes i n even more- labor-i n tensive p.. 
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{and thus more expansive) than most generic natural i stic/qual i tati ve f i el d 
2 'Studies. And for reasons inherent in the principles described above, an 
ethnographic evaluation can consume much more time in data collection, 
analysis, and writing than fi el dwork oriented by other theories. An 
ethnographic evaluation, then, can be especially impractical in 
circumstances when evaluation information is required in a short time. 

, ; Th es e_p racti c al ^dgs a dv a n tege s , Jiowey e r, do not preclude the use of ; _ 

anthropological ethnography in evaluation. Clearly,: it 9/n be an effective 
inquiry tool in studies of programs of limited scope. a Even when time or 
monetary resources are limited/ focused ethnography can be conducted in 

highly selected contexts in order to illuminate critical program 

■<?»• ■ ■ 

processes. And trained ethnographers operating from a constitutive (or 

similar anthropological ) theory can often generate useful information even : 

0. . . ■ ■ . ... — , • 

when the number of inquiry cycles is restricted/ to a. few; .Even when the 
number of inquiry cycles, is restricted by resources to a few, trained 
■ ethnographers can provide more useful , formative information than 
evaluators who' select their theories of social organziation 3dJhoc > 
Ethnographic ways of looking and thinking about what one sees can enable 
th-e ethnographer to .be more^ sensitive: td| and so more accurate in .gathering : _ 
impressions about, the functional intence^tionships among culture and * 
action. Finally, the use of ethnography in evaluation can contribute 
substantially to the gradual , pumulative^understanding of the factors and. 
dynamics that influence the eh §nd effects of various "kinds of 

programs and policies in ye^ions ^ 
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... this way, its use can help in the development , grounded ^theori 

of pro^ ... 

In summary, anthropological ethnography' does haVe a place in ; . 
evalyatibn. It can perform those tasks 

identify for natural istic/qual itative methods in general, and it can 1 end 
, eval uators' a variety of grounded theories of .social relations that; can r 
serve to help tnai n tai n 'the, <3$sc ripti ve val i df ty of the Accounts that they 



produce. 
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